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ABSTRACT 


The topic and purpose of this paper is to explore within the literature the theoretical foundations 
and applications of rubrics in the process of evaluation of retained learning and mastery of knowledge 
within the educational environment. The first step of the research was to assemble a definition of the term 
rubric from a historical perspective. From the literature, a summary of the process of creating rubrics 
and a listing of the types or variations of rubric formats is presented. The general types of rubrics include 
Holistic, Analytic, Developmental (which is considered a subset of the Analytic Rubric) and Single-Point 
Rubrics are described. A checklist for measuring qualities of a good rubric is provided. A discussion of 
the incorporation of the educational goals, objectives and learning outcomes of rubrics is reviewed. Over 
time, recommendations for modification and adapting to different instructional approaches has emerged 
within the literature and are proposed as the theoretical foundations. The theoretical foundations included 
in the rubric styles were: Bloom’s Taxonomy, Costa’s Three Levels (which are based upon the foundation 
of Bloom’s Taxonomy) and a modification of Kirkpatrick’s Four Levels. The Developmental Rubric is 
presented with several theories from authors in the field of human development, including; Jean Piaget, 
Lawrence Kohlberg, Erik Erikson, Lev Vygotsky and John Dewey. The outcome of this literature research 
for the educator is a set of working examples illustrating the variations or adaptations of rubric styles. In 
the final analysis, the simplicity and complexity of the rubric design and its application is dependent upon 
the educator and the learning environment. 
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Three Levels, Bloom’s Taxonomy 

Both students and instructors have expressed 
concern with providing timely, objective and 
constructive feedback. One study (Gallien & 
Oomen-Early, 2008) found that students who 
received personalized feedback were more satisfied 
and performed academically better than students 
who received only collective feedback. An earlier 
study (Harvey, 2001) found that while students 
rated their teachers and support highly, they were 
less than satisfied with the assessment and feedback. 
In the September issue of the Chronicle of Higher 
Education (2015), Dan Berrett (2016) proposed that 


faculty can make assignments more transparent by 
asking themselves several questions: What exactly 
do they want students to do? Task - Why are they 
asking students to do it? Purpose - How will they 
evaluate the work? Criteria (p. All). This concept 
of “transparency” was also discussed by Churchs 
(n.d.) as “...absolutely vital that the students know 
what they are being assessed on and what their 
learning outcomes and goals are. It is not acceptable 
to hand back an assessment with pass or fail and 
not explain why they achieved that particular result 
or outcome (p. 11).” Praslova, (2010), wrote that 
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selecting institutional effectiveness is a difficult task, 
particularly when it is not well defined. The same 
would hold true for assessing student effectiveness 
or grade. 

WHAT IS A RUBRIC? 

One method that can provide this feedback 
or criteria, and make it more objective, reducing 
conflict, is the use of rubrics. Not only can they 
meet the need for personalized feedback, they can 
facilitate a pre-assessment narrative between faculty 
and learners. Again, Churchs (n.d.) suggested that, 
“One of the tools we can use for providing effective 
feedback and, hence, formative assessment, is 
suitable rubrics (p. 14).” 

A rubric is a visual narrative of the criteria that 
defines and describes the important components 
of an assignment. The criteria are stated in several 
levels of competence; from not meeting the 
requirement to mastering it. As one author (Andrade, 
2005) reported, a rubric provides feedback which 
in turn provides clear and individually focused 
diagnostic feedback. This assessment tool meets 
the requirements for reliability (stating explicit 
criteria and performance indicators), validity 
(linkage with stated learning outcomes), and 
effectiveness (transparent; consistent; and detailed 
feedback), (Rubrics for Assessment, n.d.). Shipman, 
et ah, (2012, p.l) stated “.. .a rubric that consistently 
assesses student performance and provides 
meaningful feedback is essential in today’s learning 
environment. If students are not given feedback that 
is consistent or meaningful, then they may feel their 
grades are not valid, thus sending mixed messages 
to the student. When expectations are not clear, 
the unacceptable performance may transfer into 
the work environment.” A fairly comprehensive 
definition of a rubric is that the rubric must “... 
simply lists a set of criteria, which defines and 
describes the important components of the work 
being planned or evaluated” (Rubric for Rubrics, 
n.d.). In the Preface to Introduction to Rubrics, 
the authors reported that rubrics are one of the 
“handiest” tools for educators since the invention of 
the blackboard (Stevens & Levi, 2005). 

The term “rubric” is not new nor is it restricted 
to education. The term actually comes from the 
Latin “rubrlca” or red ochre. Red indicates the 
importance of the item or area and then is followed 
by an explanation. The term has long been used as 


medical labels for diseases and procedures (rubric, 
n.d). In education, the rubric is often confused with 
“checklist” (Hudson, 2014). While both methods 
are useful tools that can guide students who are 
working on school assignments, they are different 
systems for providing feedback. A checklist is not a 
rubric, it is simply a set of criteria teachers provide 
to ensure students understand how to fulfill an 
assignment. However, the criteria or checklist may 
be the first step in developing a rubric. 

In 1996, the National Research Council described 
what might be considered a format for a rubric. 
When they describe “.. .the essential characteristics 
of exemplary assessment practices...” (p. 75) and 
they proposed that the standards could be applied 
equally to the assessment of students, teachers and 
programs. This evaluation may be accomplished by 
what is now known as a rubric (Wolf & Stevens, 
2007). 

While the use of rubrics would seem to a 
natural occurrence, it seems that people either love 
rubrics or hate them. Some appreciate the time that 
rubrics can save; others find them too restrictive, 
time-consuming to develop, and too generic to be 
of any value. 

CREATING RUBRICS 

General format for developing a rubric. There 
are several formats for developing rubrics. Churchs 
(n.d.) proposed 5 stages in rubric development: 
Stage 1-Task Development (learning outcomes, key 
elements, clarity, design, outcomes and fit); Stage 
2-Assessment Mode; formative or summative, 
when used, aspects of feedback, who is assessed 
(self, peer or combinations); Stage 3-Design; style, 
terms; Stage 4-Rubric Development; criteria for 
excellence, transition from lower to higher; Stage 
5-Use and Evaluate (pp 19-25). 

The steps suggested by Mertler, (2001) include: 
1. Examine and list the criteria and learning 
objectives. 2. Determine the specific, observable 
attributes and their performance levels. Even with 
descriptive and numeric criterion in the rubric, 
there needs to be narrative feedback to clarify low 
performance. 3. Use brainstorming techniques, 
then write a description of the evidence for each 
performance level (good assignments good and the 
poor assignments poor). 4. Determine which rubric 
will best meet the goal; analytic, holistic, or single¬ 
point. 5. Develop the format or grid to be used. 6. 
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Field test the rubric, collect examples of work before 
implementation and make any necessary revisions. 
7. Share with the learner prior to the assignment. 
And 8. After use, evaluate and revise the rubric 
as needed. 

Identifying and making a list of the criteria 
usually results in several different levels of 
completion or competence, with a weighted score 
assigned to each level. While this seems like a simple 
task, this approach has enlisted controversy among 
those using them since the technique requires value 
judgement. Rubrics should be given to students 
before the assignment is undertaken. It also needs 
to clearly show how their work will be evaluated 
with a detailed explanation of what constitutes 
acceptable and well as unacceptable completion. 
The rubric should be focused on the desired learning 
outcomes, measurable, and use language that is 
descriptive and action-oriented (Grading Rubrics: 
Set Expectations, Make Feedback Delivery More 
Efficient, n.d.). 

There are a number of web sites that will help 
create a rubric. One, Utah Education Network 
(Rubric Tutorial - UEN. (n.d.), which not only 
answers the question “What is a rubric?” but also 
has examples and a tool to create them. Rcampus, 
a website, also free, provides tools to “Build 
from Scratch,” “Revise my existing rubric,” and 
“Duplicate and re-purpose an existing rubric,” 
(IRubric: Rubric Studio, n.d.). Both sites require 
registration, which is free. 

The faculty member will need to create 
their own rubric when it is not possible to find 
an appropriate existing rubric to use or modify. 
According to Mertler, (2001), Allen & Tanner, 
(2006), and Reedy, (2007) developing rubrics 
follows several steps: 1. Defining the learning 
objectives of the course, 2. Deciding upon the 
assessment methods that would be employed to 
assess the achievement of the learning goals of the 
course. 3. Describing the criteria and the levels of 
performance for the assessment method as would be 
applicable in the course. Anglin, et ah, (2008) stated 
that the rubric is an attempt to quantify qualitative 
judgment. This occurs when going through the 
process of documenting observable and measurable 
aspects of student performance. Further, the rubric 
should be shared with students in advance of the 
assignment and assessment. Even with descriptive 
and numeric criterion in the rubric, there needs to 


be narrative feedback from the students to clarify 
low performance. 

TYPES OF RUBRICS. 

Three main types of rubrics exist - Holistic, 
Analytical, and Single-Point. A subset of the Analytic 
Rubric is titled the Developmental Rubric. The 
Analytic Rubric will be discussed later in the paper. 
The key difference between the various types are 
the purpose, number of discrete criteria addressed 
in the rubric, and the use of narrative descriptions 
of performance. Table 1, Holistic, Analytic, 
Developmental, and Single-Point: Advantages and 
Disadvantages, shows the relationships and their 
relative advantages and disadvantages. 

In the following discussion, the rubrics will 
be shown in the Fist of Tables. The various styles 
will also be illustrated, in general, as the rubrics 
are made up of columns (2-5) and rows (2-5) with 
the scoring and descriptions provided in alternating 
columns and rows. 

Holistic Rubrics. A Holistic Rubric is the 
most general kind and lists three to five levels 
of performance, along with a broad description 
(holistic) of the characteristics that define each level. 
In Table 2, Holistic Rubric Template using Bloom’s 
Taxonomy, the general format is displayed; scores 
for each description can range from not attempted 
(0 points) to exceptional understanding (4 points) 
which is shown in the first column and descriptions 
in the corresponding columns. 

Holistic Rubric Advantages: Creating a Holistic 
Rubric takes less time than the others, and grading 
with one is also faster. The teacher can look over 
an assignment and give one holistic score. They 
are quick to score and this approach provides an 
overview of the student’s achievement. 

Holistic Rubric Disadvantages: The main 
disadvantage of a Holistic Rubric is that it does not 
provide targeted and specific feedback to students 
nor does it give very detailed information (Gonzalez, 
p.1,2014). 

Analytic rubrics. An Analytic Rubric breaks 
down the characteristics of an assignment into parts. 
This allows the scorer to itemize and define exactly 
what aspects are strong, and which ones need 
improvement (Gonzalez, p.2, 2014). Again, as in 
the Holistic Rubric, the Analytic rubric can contain 
three to five areas of performance. Table 3, Template 
for Analytic Rubric, displays the categories in the 
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vertical column and scoring in the horizontal rows. 
In this example, there are four vertical cells for the 
category number and five cells for the narrative. The 
fifth column is used to record the score. 

Analytical Rubric Advantages: The rubric 
gives students a clearer view of the evaluation and 
provides meaningful and specific feedback. Scoring 
tends to be more consistent across students and 
grades, and helps students understand the nature of 
quality work (Rubrics, 2012). 

Analytical Rubric Disadvantages: There are 
two significant disadvantages: 1. The time necessary 
to create them. 2. The students may not read them. 

Developmental Rubrics. A Developmental 
Rubric is considered a subset of the Analytic 
Rubrics. According to an article atDePaul University 
(Types of Rubrics, p. 2. 2015), “...the purpose of 
Developmental Rubrics is not to evaluate an end 
product or performance. Instead, developmental 
rubrics are designed to answer the question, to what 
extent are students who engage in our programs/ 
services developing this skill/ability/value/etc.?” 
Developmental Rubrics define strategies, and 
the criterion contains a small set of competing 
strategies unique to it (Changing Wisdoms, n.d.). 
Developmental Rubrics can be based on relevant 
developmental theory and requires a close tie 
between assessment criteria and the theory of 
development. An example of the Developmental 
Rubric is shown in Table 9 Template Developmental 
Rubric, using Learning Theory. 

Developmental Rubric Advantages: Useful 
when the goal of evaluation is to determine the level 
of development rather than the quality of a final 
product and to monitor student progress. There may 
also be no expectation that students should or could 
fully develop a skill or ability during their education. 
An example would be “Maslow’s Hierarchy of 
Needs,” there is no expectation that students can or 
will become self-actualized (Maslow, 1958). 

Developmental Rubric Disadvantages: 
Conceptually, this type of rubric is difficult to 
design. Creating a Developmental Rubric requires 
a close tie between assessment criteria and the 
theories of development. 

Single-Point Rubrics. A Single-Point Rubric 
main characteristic in common with the Analytic 
Rubric breaks down the components of an 


assignment into different criteria. What makes the 
rubric different and only describes the criteria for 
proficiency. The Analytic Rubric does not attempt 
to list all the ways a student could fall short, nor 
specifies how a student could exceed expectations 
(Gonzalez, p. 3, 2014). While the rubric can 
contain three or more areas of performance, as a 
Single-Point, one or two areas are probably more 
appropriate. In Table 4, Template #1 for Single-Point 
Rubric, the Rubric has three columns, and six rows. 
The titles of the columns indicate the evaluation 
and feedback (from Concerns to Advance) while 
the columns represent each Criteria description for 
achieving “mastery” or competence. The faculty 
member provides narrative feedback in the open 
cells. Along the bottom cells there are a range of 
points, depending on the level of mastery of the 
criteria. 

A second example of the Single-Point Rubric is 
displayed below. This format is similar to Table 4, 
but shows the Criteria in the first column with cells 
for evaluation and feedback in the corresponding 
and adjacent columns. 

Single-Point Rubric Advantages'. The Single- 
Point Rubric has several advantages. 1. Contains 
far less language, 2. Takes less time to create while 
still providing rich detail about expectations. And, 
3. Provides location to record areas of concern and 
excellence which are open-ended (Gonzalez, p. 3, 
2014). 

Single-Point Rubric Disadvantage: The main 
disadvantage of Single-Point Rubrics is that using 
them requires more writing on the teacher’s part 
(Gonzalez, p. 3, 2014). The strength of providing 
detailed feedback is also a weakness; the task is 
time-consuming. 

DESCRIPTION OF PERFORMANCE: 

GENERAL OR TASK-SPECIFIC. 

Each of these rubric types can be categorized 
as being either “General” or “Specific.” In Table 6, 
Two Major Sub Divisions of Rubrics: General and 
Task-Specific, each is described with the respective 
strength and weakness. Use a general rubric in order 
to assess levels of reasoning, skills and products 
when students are not doing the same task. Use 
a specific rubric when assessing knowledge and 
consistency of scoring is desired and is important 
(Brookhart 2008, and Gonzales, 2014). 
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WHAT ARE THE QUALITIES OF A “GOOD” RUBRIC? 

No rubric is better than the others. According 
to Custer (1996), all have a place in authentic 
assessment. They should correspond as closely as 
possible to real world experience and go beyond 
the typical pencil and paper activity (Montgomery, 
2002). Each form of rubric calls for greater 
accountability and transparency, especially in 
the assessment of what students have been taught 
(Diller & Phelps, 2008). 

In the Fundamentals of Rubrics, Bargainnier 
(2003) discusses the attributes of a quality rubric. 
Regarding the criteria, the rubric must be clear; 
define a comprehensive set of behaviors that make 
up the performance, and describe each level of 
performance. 

When examining the language, the rubric needs 
to be rich and descriptive. Then the rubric provides 
the definitions, indicators, illustrates the different 
levels of required performance using tangible and 
qualitative terms in each descriptor. 

The focus of the rubric needs to be positive 
attainment; each level should help both learner 
and faculty member distinguish the differences 
in levels of performance. As with any instrument, 
the rubric must be be valid; accurately measuring 
key aspects central to the quality of performance. 
Thus producing reliable and consistent results for 
different users. 

Stevens & Levi (2004) proposed a Metarubric 
or rubric to evaluate rubrics. Table 19, A Rubric 
for Judging Your Rubric and Table 20 Metarubric 
Checklist. Table 19 is the Checklist in Rubric 
format. Rather than a rubric, this instrument looks 
more like a checklist, but still offers several useful 
observations. This approach is divided into several 
sections; the dimensions, the descriptions, the scale, 
the overall rubric, and fairness and sensibility. 

The dimensions: provides important parts of 
the final student performance, capture some key 
themes, is clear, distinctly different, and identifies 
skills. 

The descriptions: matches the dimensions, a 
clear basis for assigning points, the descriptions are 
appropriately and equally weighted. 

The scale: represents that level of performance, 
encouraging and informative, and has a reasonable 
number of levels. 

Fairness and sensibility: provides measurement 


that are fair to all students and free of bias, useful as 
performance feedback, practical, and makes sense 
to the reader. 

The overall rubric has to clearly connect to 
the outcomes, should be easily understood, should 
reflect teachable skills, and should reward or 
penalize students on unrelated outcomes. Further, 
all students have an equal opportunity to learn 
from the rubric. Designed to be appropriate for 
the conditions in that it 1. Includes a description or 
title, 2. Measures performance as a developmental 
task, 3. Informs the student about the evaluation 
procedures, and 4. Is an appraisal of individual or 
group performance and describes ways to improve. 
In the final analysis, a rubric should also be fair to 
all students in regards to reading level, language, 
examples. Criterion should not be a surprise for 
the student (Custer, 1996, Diller & Phelps, 2008, 
and Montgomery, 2002, Stevens & Levi). The 
one rubric that should be avoided is the “Surprise 
Rubric,” one that appears after the assignment has 
been submitted (Stevens & Levi, 2005). Rubrics 
should always be shared with the students prior to 
the submission of the assignment. 

THEORETICAL FOUNDATIONS 

The method for determining the evaluation 
criterion has several possibilities. Use the steps 
suggested by Mertler (2001). Use brainstorming 
and field testing interactively with the involved 
students (Grading Rubrics, n.d.). Set expectations, 
make feedback and delivery more efficient (Bloom, 
1965). 

Since both the formats both by Mertler (2001) 
and the IT Lab at the University of New Brunswick 
(Grading Rubrics, n.d.), suggest a theoretical 
foundation, this paper will use Bloom (1965), Costa 
Three Levels (1985), and Kirkpatrick’s Four Levels 
(1996) each with some revisions, as the criterion. 

Bloom’s Taxonomy. In adopting Bloom’s 
taxonomy, use Bloom’s questions and key words 
in developing the categories for measurement. 
In 2000, the Taxonomy was revised (Airasian, 
Anderson, Cruikshank, Krathwohl, Mayer, Pintrich, 
... & Wittrock) to move Synthesis to the first step of 
Creating. The second step became Evaluation. 

The new terms are defined as: 

Remembering (Describe). Retrieving, 
recognizing and recalling relevant knowledge from 
long-term memory. 
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Understanding (Summarize). Constructing 
meaning from oral, written, and graphic messages 
through interpreting, exemplifying, classifying, 
summarizing, inferring, comparing, and explaining. 

Applying (Construct a theory). Carrying 
out or using a procedure through executing, or 
implementing), analyzing (Differentiate between). 
Break material into constituent parts, determine 
how the parts relate to one another. 

Analyze (Analyzing). Breaking material into its 
constituent parts and detecting or perceiving how 
the parts relate to one another and the structure or 
purpose. 

Evaluating (Assess whether or not), Making 
judgments based on criteria and standards through 
checking and critiquing. 

Creating (Compose or create). Putting elements 
together to form a coherent or functional whole; 
reorganizing elements into a new pattern or struc¬ 
ture through generating, planning, or producing 
(Anderson & Krathwohl, 2001, pp. 67-68). 

Costa Three Levels. Since the main complaint 
about rubrics is the complexity and time to develop 
the evaluation criterion, Costa’s (1985) three levels 
will also be used as examples. Each level, as in 
Bloom, has key words (“Signal Words”) that can 
form the basis for the criterion. 

Level One (Define). Focus on gathering and 
recalling information 

Signal Words. Describe - to represent or give an 
account in words. Identify - to establish the identity 
of. List - a simple series of words or numbers. Name 
- to mention or identify by name. Observe - to see 
or sense esp. through careful attention. Recite - to 
repeat verbatim, and Scan - to examine closely. 

Level Two (Analyze). Making sense of gathered 
information 

Signal Words. Examine - a thing to know its 
parts. Compare - to examine for likenesses and 
differences. Contrast - to show differences when 
compared. Group - to cluster. Infer - to derive as 
a conclusion from facts or premises. Sequence - 
chronological order of events, or Synthesize - the 
combination of parts or elements into a whole. 

Level Three (Apply). Applying and evaluating 
gathered information. 

Signal Words. Evaluate - appraise, value. 
Hypothesize - to adopt as a hypothesis/assumption. 


Imagine - to form a mental picture of something 
not present; guess. Judge - to form an estimate or 
evaluation about something. Deduce, Predict - to 
declare in advance, or speculate - to think or wonder 
about a subject. 

Kirkpatrick’s Four Levels. Originally devel¬ 
oped as a model to evaluate presentations by the 
impact on the student. They are modified for use 
in this paper. There are four levels: 1. Reaction of 
student - what they thought and felt about the 
training; 2. Learning - the resulting increase in 
knowledge or capability; 3. Behavior - the extent 
of behavior and capability improvement and imple¬ 
mentation/application; and 4. Results - the effects 
on the business or environment resulting from the 
trainee’s performance. 

New World Model. Kirkpatrick, J. D., & 
Kirkpatrick, W. K. (2010) proposed a modification 
which, while keeping the four levels, made some 
modifications. Level 1 “reaction” now includes the 
issues of customer satisfaction, engagement (active 
involvement) and relevance (will the participants be 
able to use or apply what they learned). Level 2 is 
still “learning” (knowledge, skill, and attitude) but is 
expanded to include two additional areas: confidence 
(thinking they can do it) and commitment (intention 
to do it on the job). Level 3 “behavior” (application 
of what they learned to the job) now is expanded 
to include “required drivers.” Required drivers are 
those specific processes and systems that reinforce, 
encourage and reward performance of critical 
behaviors on the job (Kirkpatrick, J., & Kirkpatrick, 
W, 2011). The last level. Level 4, still measures 
results (degree that targeted outcomes occur as an 
outcome of the training) and now includes “leading 
indicators.” Kirkpatrick, J., & Kirkpatrick, W, 
(p. 66 2011, November 1) define these as “short 
term observations and measurements that suggest 
that critical behaviors are on track.” These levels 
could be modified to be used in a rubric for learner 
evaluation and feedback. 

Level one (Reaction). To what degree 
participants react favorably to the training. 

Indicators. Customer Satisfaction. An indication 
of satisfaction with the concepts addressed in the 
assignment, met their needs, and achieved a goal. 
New World Additions: Engagement. Indication of 
the student’s active involvement in and contributing 
to the learning experience, mentally stimulated 


GRAND CANYON UNIVERSITY 




25 


attention, curiosity, interest, optimism, and passion. 
Relevance. Indication of an opportunity to use 
or apply what they learned from the assignment, 
application to the personal aspirations, interests, or 
cultural experiences of students (personal relevance) 
or are connected in some way to real-world issues, 
problems, and contexts (life relevance). 

Level two (Learning). To what degree 
participants acquire the intended knowledge, skills, 
attitudes, confidence and commitment based on 
their participation in a training event 

Indicators. 

Knowledge. “Knowing” the material from 
the assignment; Tell, list, describe, name, repeat, 
remember, recall, identify, state, select, match, 
know, locate, report, recognize, observe, choose, 
who, what, where, when, cite, define, indicate, 
label, memorize, outline, record, relate, reproduce, 
underline. 

Skill. Student’s confidence that they can now do 
what is included or required in the assignment. 

Attitude. What is included in the assignment 
will be worthwhile or useful on the job. 

New World Additions: 

Confidence. Belief they can apply the content of 
the assignment. 

Commitment. Intention to use the content of the 
assignment. 

Level three (Behavior). To what degree 
participants apply what they learned during training 
when they are back on the job. 

Indicators. Indicators (measured indirectly). 
The assignment includes an indication of intention 
to use what was include in the assignment, practical 
application, process to carry it out, skills, knowledge, 
or attitude. 

New World Addition: 

Required Drivers. The student includes a 
discussion of processes and systems that reinforce, 
encourage and reward performance of critical 
behaviors on their job. 

Level Four (Results). To what degree targeted 
outcomes occur as a result of the training event and 
subsequent reinforcement. 

Indicators. Indicators (measure indirectly). The 
assignment incorporates a plan of action which 
will apply the assignment and an analysis of the 
likelihood of success and resources needed. 


New World Addition: 

Leading Indicators. A plan for short-term 
observations and measurements suggesting that 
critical that would measure the behaviors and how 
to indicate if they are on track to create a positive 
impact on desired results. 

Developmental Theories. These theories 
typically look at development or growth, as in 
an intellectual sense, as stages. These theorists 
included the following: 

Sigmund Freud (Freud & Strachey, 1975) who 
looked at the Psychosexual Stages; 

John Dewey (1922) who viewed knowledge as 
arising from adaptation or habit; and, Abraham 
Maslow (1954) who proposed that human needs 
formed a hierarchy from basic survival to more 
advanced needs to achieve their potential. 

Gonzales (2014) proposes the theories that 
would most align with this rubric are those that 
explore changes as the person grows cognitively 
(in knowledge, different perspectives, world views), 
intrapersonal (awareness of their values, socially, 
culturally), and interpersonally (relationships with 
others, group norms, social systems). 

A few of the theories that have application in 
the learning environment have notable proponents; 

Jean Piaget (1997) is identified with 
Constructivism-learning is an active process; 
Lawrence Kohlberg (1984), building on the works 
of Piaget, wrote about Moral Development Stages 
of Pre-conventional, Conventional, and Post 
conventional; 

Erik Erikson (1193), continued the work 
of Sigmund Ereud (1975), and proposed the 
Psychosocial Development Stages One-Trust, 
through Eight-Integrity); and, Eev Vygotsky (1980) 
presented the Zone of Proximal Development (ZPD) 
progressed from “what is known” to “what is not 
known” or learning, with guidance that becomes 
less as the learner masters the topic. 

Since these theories are somewhat diverse it 
is difficult to propose specific indicators beyond 
those of progression from a beginning point to the 
current status. As Gonzales (p. 1, 2013) observed 
in “Types of Rubrics,” they range from Eevels of 
Initial, Intermediate, to Mature. 

RUBRIC TEMPLATES 

When deciding to develop and use rubrics, the 
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teacher progress to the step of finding an existing 
one, or create their own. Fortunately, as discussed 
earlier, there are web sites that provide sample 
rubrics. In addition, the steps of creating a rubric 
are provided. An example would be the web site 
in the Utah Education Network. UEN connects all 
Utah school districts, schools, and higher education 
institutions to a network of educational resources. 
UEN is one of the nation’s premier education 
networks (Rubric Tutorial, n.d.). The site requires 
registration, but is free. On the “Personal page” 
at the bottom left corner there is a link “Rubric 
Creation” which takes one to the Rubric Tool page. 

The rubrics follow the same structure; each 
uses columns and rows. The criteria are either in 
the column or row with the evaluation or feedback 
being in the other. The final product resembles a 
spreadsheet. The faculty member selects the type of 
rubric; Holistic, Analytic, Developmental, or Single- 
Point. Next the number of criteria for evaluation or 
feedback is selected, two to five. The faculty can 
create the rubric using a website or word processing 
program. 

Most of the Course Management Systems 
(CMS) have a rubric template as part of the available 
resources. Microsoft has several templates within 
the Word program. A template is provided in this 
article. Table 1 Microsoft Rubric Template. 

In the attachment to this paper, Eist of Tables, 
there are several example of the template forms 
for each type of rubric with their respective theory 
provided in this article. Each reference below is 
a link to the example found in the appendix. The 
links are for the convenience of the reader: 

Table 1 Microsoft Rubric Template 

Table 2 Holistic Rubric Template using 
Bloom’s Taxonomy 

Table 3 Holistic Rubric Template using 
Costa Three Eevels 

Table 4 Holistic Rubric Template using 
Kirkpatrick’s Eour Eevels 

Table 5 Analytic Rubric Template using 
Bloom’s Taxonomy 

Table 6 Analytic Rubric Template using 
Costa Three Eevels 


Table 7 Analytic Rubric Template using 
Kirkpatrick’s Eour Eevels 

Table 8 Single-Point Rubric Template using 
Bloom’s Taxonomy 

Table 9 Single-Point Rubric Template using 
Costa Three Eevels 

Table 10 Single-Point Rubric Template using 
Kirkpatrick’s Pour Eevels 

Table 11 Template Developmental Rubric. 

Additionally, there are two tables that can be 
used by the instructor in obtaining and organizing 
solicited feedback regarding the newly created 
rubric: Table 21 A Rubric for Judging Your Rubric 
and Table 22 Metarubric Checklist. 

Selecting to use a rubric brings a set of decisions: 
how to develop the criteria and obtain feedback 
regarding the rubric’s quality and usefulness. The 
criteria must trace back to the course Purpose 
Statement and the overarching Goals of the class 
(likely a Holistic Rubric). A course’s Teaming 
Objectives or Outcomes probably would require 
an Analytic Rubric. A specific Student Teaming 
Outcome could use a Single-Point Rubric. While 
these definitions may change from institution to 
institution they are similar (Definitions of Goals, 
Objectives, and Outcomes, 2015) and (Goals, 
Objectives and Teaming Outcomes, n.d.). 

APPLYING A STRATEGY FOR RUBRIC DEVELOPMENT 

Theoretical Foundations. There is no lack 
of recommendations for how to write rubrics, the 
formatting, how to identify a quality rubric, and 
steps. In this paper, the authors will discuss and 
give examples using the theoretical foundations of 
Bloom’s Six Eevel Taxonomy, Costa’s Three Eevels, 
a modification of Kirkpatrick’s Pour Eevels, and 
Developmental Theory. 

Types of Rubrics. The Rubrics; Holistic, 
Analytic, Developmental and Single-Point, will 
demonstrate methods involving integrating the 
course purpose and objectives, and learning 
outcomes. Por purposes of brevity, the examples will 
only include two areas: highest, or mastery levels, 
and lowest, or beginning levels. The examples will 
also include an abbreviated version of the complete 
description of the criteria. Por a complete example 
of each, and their respective rubrics will appear in 
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the List of Tables, at the end of the paper. 

The Developmental Rubric, Table 11, and 
corresponding theory, will not be examined 
separately since the rubric and theory are so closely 
related. However, since the Developmental Rubric is 
a subset of the Analytic Rubric, it could be developed 
using the same techniques. As Gonzales (p. 2, 2015) 
noted “The main distinction between developmental 
rubrics and other analytic trait rubrics is that the 
purpose of developmental rubrics is not to evaluate an 
end product or performance. Instead, developmental 
rubrics are designed to answer the question, “...to 
what extent are students who engage in our programs 
or services developing this skill or ability or value?” 
The Developmental Rubric would have three areas: 
Initial Level of Development, Intermediate Level of 
Development, and Mature Level of Development. 

Using the Holistic Rubric allows the student 
and instructor to focus on the “over-arching” goal 
or purpose of the class. The first example is of the 
course content, “This course is designed as a survey 
course that will address business terminology, 
concepts, and current business issues.” The second 
example is of the course style, “This course is an 
introduction to the effective use and application of 
APA style writing.” Using Table 1, Holistic Rubric 
Template using Bloom’s Taxonomy, insert the 
criteria as the outcome, “This course is designed 
as a survey course that will address business 
terminology, concepts, and current business issues” 
and “This course is an introduction to the effective 
use and application of APA style writing.” 

The following table is an example of both 
using Bloom’s Taxonomy in a Holistic Rubric. 
Only the highest and lowest examples are shown. 
For a complete display of each level, go to Table 
15 Analytic Rubric using Bloom’s Taxonomy for 
Course Content and Course Style Examples. 


Table 12 


Holistic Rubric using the Bloom Taxonomy 
Criteria description for the two examples: Course 
Content and Course Style Examples. 


Score Description 

6 

Demonstrates exceptional understanding by Creating, 
putting elements together to form a coherent or functional 
whole of the relationships between business terminology, 
concepts, and current business issues; putting elements 
together to form a coherent or functional whole; a new 
pattern or structure. 

6 

Demonstrates exceptional understanding by Creating or 
reorganizing elements into a new pattern or structure 
through generating, planning, or producing the effective 
use and application of APA style writing; applying, evaluate, 
andjudge. 

Score Description 

1 

Demonstrates minimal understanding of the material Few 
reguirements are met Remembering relevant knowledge 
ofthe relationships between businessterminology, 
concepts, and current business issues; describing, 
recognizing, and recalling relevant knowledge. 

1 

Demonstrates minimal understanding ofthe material. Few 
reguirements are met. Remembering the effective use and 
application of APA style writing 
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Using Costa’s Three Levels for these examples 
would produce the following example for the 
highest and lowest scores. For a complete display 
of each level, go to Table 16 Analytic Rubric using 
Costa Three Levels-Course Content and Course 
Style Examples. 

Table 13 

Holistic Rubric using Costa’s Three Levels 
Criteria description for the two examples: Course 
Content and Course Style Examples. 


Score Description 

3 

Demonstrates exceptional understanding of the material. 

All requirements are met and some are exceeded. 

Level Three (Apply); applying and evaluating gathered 
information about the business terminology, concepts, 
and current business issues; applying and evaluating 
gathered information. 

3 

Demonstrates exceptional understanding of the material. 

All requirements are met and some are exceeded. Level 
Three (Apply); applying and evaluating the effective use 
and application of APA style writing; applying, evaluate, 
andjudge. 

Score Description 

1 

Demonstrates partial understanding of the material. 

Some requirements are met. Level One (Define); focus 
on recalling the business terminology, concepts, and 
current business issues; applying and evaluating gathered 
information. 

1 

Demonstrates partial understanding of the material. 

Some requirements are met. Level One (Define); focus 
on the effective use and application of APA style writing; 
describe, identify, list, name, and scan. 


Using Kirkpatrick’s Four Levels for these same 
examples would produce the following for the 
highest and lowest scores. Table 17 Analytic Rubric 
using Kirkpatrick’s Four Levels-Course Content and 
Course Style Examples, shows the complete review 
for Course Content and Course Style Examples. 

Table 14 


Holistic Rubric using Kirkpatrick’s Four Levels 
Criteria description for the two examples: Course 
Content and Course Style Examples. 


Score Description 

4 

Demonstratesexceptional understanding of the material. 

All requirements are met and some are exceeded 
and included a plan for the application of the business 
terminology, concepts, and current business issues; 
results-a plan for action which will apply the assignment, 
a plan to measure the behaviors and howto indicate if they 
are on track to create a positive impact on desired results. 

4 

Demonstrates exceptional understanding of the material. 

All requirements are met and some are exceeded and 
included a plan forthe application of the effective use 
and application of APA style writing; results-assignment 
incorporates a plan of action indicate iftheyareontrackto 
create a positive impact on desired results. 

Score Description 

1 

Demonstrates the minimal understanding of the material. 
Few requirements are met. A lack of personal or life 
relevance of the business terminology, concepts, and 
current business issues; results-a plan of action which 
will apply the assignment, a plan to measure the behaviors 
and howto indicate if they are on track to create a positive 
impact on desired results. 

1 

Demonstrates minimal understanding of the material. Few 
requirements are met. A lack of personal or life relevance 
of the effective use and application of APA style writing; 
reaction-indications of the student's active involved in 

and contributing to the learning experience, mentally 
stimulated, attention, curiosity, interest, optimism, and 
passion, connected in some way to real-world issues, 
problems, and contexts 
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COURSE OBJECTIVE(S). 

Using the Analytic Rubric allows a more specific analysis of each objective. Course content example 
“The student will identify and analyze business cycles.” Course style example “The student will correctly 
list the five levels of APA style headings.” 

Using Bloom’s Taxonomy for these examples would produce the following for the different scores. 
The display shows each if the six areas: Knowing, Comprehension, Application, Analysis, Synthesis, and 
Evaluation. 

Table 15 


Analytic Rubric using Bloom’s Taxonomy for Course Content and Course Style Examples 


Analytic 

Knowing 

1 

Comprehension 

2 

Appiication 

3 

Analysis 

4 

Synthesis 

5 

Evaluation 

6 

Score 

Category#! 

Description 

Description reflecting 

Description 

Description 

Description 

Description 


Course Content 

reflecting 

movement toward a 

reflecting 

reflecting 

reflecting 

reflecting highest 



beginning level 

level of performance; 

achievement of 

highest level of 

achievement of 

level of mastery; 



oferformance; 

by identifying and 

a higher level of 

performance; 

mastery level of 

by identifying and 



by describing 

analyzing business 

performance; 

in identifying 

performance; in 

analyzing business 



specific facts, 

cycles. 

identifying and 

and analyzing 

identifying and 

cycles. 



ideas,vocabulary 


analyzing business 

business cycles. 

analyzing business 




in identifying and 
analyzing business 
cycles. 


cycles. 


cycles. 



Category #2 

Description 

Description reflecting 

Description 

Description 

Description 

Description 


Course Style 

reflecting 

movement toward a 

reflecting 

reflecting 

reflecting 

reflecting 



beginning level 

level of performance; 

achievement of 

highest level of 

achievement of 

achievement of 



ofperformance; 

by showing tbe value 

a higher level of 

performance; 

mastery level of 

mastery level of 



by remembering 

(in order) related to the 

performance; 

by listing the five 

performance; by 

performance; by 



(listing) tbe 

five levels of APA style 

by synthesizing 

levelsof APA 

applying the five 

applying the five 



specific facts 

headings. 

(relationship to 

style headings. 

levelsof APA style 

levelsof APA style 



related to listing 


subject sentences) 


headings. 

headings. 



tbe five levels 


the relationship 






of APA style 


by listing the five 






headings. 


levels of APA style 
headings. 
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Using Costa’s Three Levels, for these examples, would produce the following for the different scores. In 
Costa’s display all three evaluation area are listed: Developing, Accomplished, and Exemplary. 


Table 16 

Analytic Rubric using Costa’s Three Levels-Course Content and Course Style Examples 



Developing! 

Accomplished 2 

Exemplary 3 

Score 

Category#! 

Course Content 

Description reflecting 
movement toward mastery level 
of performance by defining, 
describing, identifying and 
analyze business cycles. 

Description reflecting 
acbievement of mastery level 
of performance. Tbe student 
will identify,compare,contrast, 
synthesize and analyze business 
cycles. 

Description reflecting highest 
level of performance The student 
will identify, analyze, and evaluate 
the business cycles. 


Category #2 Course Style 

Description reflecting 
movement toward mastery level 
of performance by defining, 
describing, and examine factors 
related to listing tbe five levels of 
APA style headings. 

Description reflecting 
achievement of mastery level 
of performance by analyzing, 
examining, comparing, 
contrasting, synthesize factors 
related to listing the five levels of 
APA style headings. 

Description reflecting highest 
level of performance by applying, 
and evaluating the five levels of 

APA style headings. 



The following table displays the results for Kirkpatrick’s Four Levels: Beginning, Developing, 
Accomplished, and Exemplary. 


Table 17 

Analytic Rubric using Kirkpatrick’s Four Levels-Course Content and Course Style Examples 



Beginning! 

Developing 2 

Accomplished 3 

Exemplary 4 

Score 

Category#! Course 
Content 

Description reflecting 
beginning level of 
performance The 
student will apply, 
identify, and analyze 
business cycles. 

Description reflecting 
movement toward 
mastery level of 
performance. The 
student will apply with 
confidence, identify, 
and analyze business 
cycles. 

Description reflecting 
achievement of 
mastery level of 
performance The 
student will show an 
application, identify, 
and analyze business 
cycles. 

Description reflecting 
highest level of 
performance The 
student will plan 
for short-term 
observations and 
measurements, 
identify, and analyze 
business cycles. 


Category #2 Course 
Style 

Description reflecting 
beginning level of 
performance. The 
student will list the 
five levels of APA 
style headings and 
connected in some 
way to real-world 
issues, problems, and 
contexts. 

Description reflecting 
movement toward 
mastery level of 
performance. The 
student will list the 
five levels of APA 
style headings and 
acquire the intended 
knowledge, skills. 

Description reflecting 
achievement of 
mastery level of 
performance. The 
student will list the 
five levels of APA 
style headings and 
participants apply 
what they learned. 

Description reflecting 
highest level of 
performance The 
student will list the 
five levels of APA 
style headings and 
proposed measures 
to evaluate, and get 
feedback. 
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SPECIFIC LEARNING OUTCOME. 

The Single-Point Rubric can focus on a specific and detailed learning point. 

Course content example “The student will correctly define GDP as the output in dollars (or another 
currency) of final goods and services produced in a country in a given year.” 

Course style example “The student will correctly list and apply the five levels of APA style headings.” 
In the following tables, Table 18,19, and 20, the display is for Single-Point Rubrics. The Course content 
and Course style are shown in only the Meets Criteria, “Standards for This Performance,” and space left for 


narrative in “Areas that Need Work” and “Evidence of Exceeding Standards.” 

Table 18 

Single-Point Rubric using Bloom’s Taxonomy-Course Content and Course Style Examples 


Concerns 

Areas that Need Work 

Meets Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 


Criteria#!: 

Description reflecting achievement of mastery level 
of performance. The student will correctly define 
GDP as the output in dollars (or another currency) 
of final goods and services produced in a country in 
a given year. 



Criteria #2: 

Description reflecting achievement of mastery level 
of performance. The student will correctly list and 
apply the five levels of APA style headings. 



Table 19 

Single-Point Rubric using Costa’s Three Levels Course Content and Course Style Examples 


Concerns 

Areas that Need Work 

Meets Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 


Criteria #1: Course Content. Description reflecting 
achievement of mastery level of performance the student will 
define GDP as the output in dollars (or another currency) of 
final goods and services produced in acountry in agiven year 
with an application of what they learned. 



Criteria #2: Course Style. Description reflecting achievement 
of mastery level of performance. The student will correctly 
list and apply the five levels of APA style headings with an 
application ofwhatthey learned. 
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Table 20 

Single-Point Rubric using Kirkpatrick’s Four Levels Course Content and Course Style Examples 


Concerns 

Areas that Need Work 

Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 


Criteria#!: 

Course Content.Description reflecting achievement 
of mastery level of performance. The student will 
define GDP as the output in dollars (or another 
currency) of final goods and services produced in a 
country in a given year with an application of what 
they learned. 



Criteria#?: 

Course Style.Description reflecting achievement 
of mastery level of performance.The student will 
correctly list and apply the five levels of APA style 
headings with an application of what they learned. 



CONCLUSION 

Teaching is the most noble of professions. Young 
minds are shaped, mature minds can be redirected, 
and in the end, a small piece of society can be 
enhanced from the efforts of a single instructor. 
History is filled with examples of the effects of 
changes made brought about from the efforts and 
inspiration that resulted from an hour of instruction. 
However, hidden under the obvious outer shell of 
the student instruction, the eternal question remains: 
“How does an instructor actually assess the amount 
of learning and newly acquired skills acquired that 
resulted from their efforts working with students?” 
Is it possible that an instructor with a curriculum 
that satisfies the required number of contact hours, 
goals for outside research, and report-writing 
actually produces an instructional period where 
no learning takes place? Has the instructor left the 
students unchallenged, confused, frustrated and 
disappointed with an obviously capricious system 
of final evaluation and grading of performance? 

The questions raised above have been addressed 
over the past century by theoreticians, academia, 
educators, and general researchers. Those writers 
have provided their perceptions of the measurement 
of actual learning and mastery of theories and skills. 
They have broken the learning process into a series 
of measurable steps. Writers and their research 
were presented within the article. Here the various 
approaches to answering the eternal question, 
“Did learning take place and to what degree were 
presented and discussed?” 


The birth of the rubric a “learning measurement 
tool” and its evolutionary process has been 
presented. The contributors to rubric building and 
the refinement process are provided and examples 
of the application of rubrics are illustrated for the 
reader of this article. The refinement of the rubric 
building process of including the students in 
creating the grading/evaluation process may seem 
to some as being revolutionary. The student and 
the instructor can become partners in the learning 
experience. From this partnership, a learning 
experience can be designed using the rubric as the 
foundation with which to bolt the curriculum and its 
myriad of learning objectives. 

The evolution of the rubric will never be finished. 
The article provides the argument that learning and 
student performance can be accurately measured. 
The learning experience can be dramatically 
enhanced when a partnership is established 
between the instructor and students where realistic, 
meaningful and attainable evaluation procedures 
are presented. 

Where education will progress in the future 
is unknown. But as long as tools such as rubrics 
are incorporated, the student and the teacher will 
produce the optimum learning experience. The 
reward will be mutual. 
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TABLES 


Table 1 

Microsoft Rubric Template 



Beginner 

Developing 

Accomplished 

Advanced 


1 

2 

3 

4 

Dimension 1 





Dimension 2 






Table 2 

Holistic Rubric Template using Bloom’s Taxonomy 


Score 

Description 

6 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded. 

Creating (Compose or create): Putting elements together to form a coherent or functional whole; reorganizing elements Into anew pattern 
or structure through generating, planning, or producing 

5 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded. 

Evaluating (Assess whether or not): Making judgments based on criteria and standards through checking and critiquing. 

4 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded. 

Analyze (Analyzing): - Breaking material Into Its constituent parts and detecting or perceiving how the parts relate to one another and to 
an overall structure or purpose 

3 

Demonstrates consistent understanding of the material. All requirements are met. 

App/y/ng (Construct atheory): Carrying out or using a procedure through executing, or Implementing), Analyzing (Differentiate 
between...): Breaking material Into constituent parts, determining how the parts relate to one another and to an overall structure or 
purpose through differentiating, organizing, and attributing. 

2 

Demonstrates partial understanding of the material. Some requirements are met. 

Understanding (Summarize): Constructing meaning from oral, written, and graphic messagesthrough Interpreting, exemplifying, 
classifying, summarizing. Inferring, comparing, and explaining. 

1 

Demonstrates minimal understanding of the material. Few requirements are met. 

Remembering (Describe): Retrieving, recognizing, and recalling relevant knowledge. 

0 

No response; Task not attempted. 
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Score 

Description 

3 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded. 

Level Three (Apply); applying and evaluating gathered information. 

Signal Words. Evaluate - appraise, value, Hypothesize - to adopt as a hypothesis/assumption. Imagine - to form a mental picture of 
something not present; guess. Judge - to form an estimate or evaluation about something. Deduce, Predict - to declare in advance, or 
speculate - to think or wonder about a subject. 

2 

Demonstrates consistent understanding of the material. All requirements are met. 

Level Twe (Analyze); making sense of gathered information. 

Signal Words. Examine - a thing to know its parts. Compare - to examine for likenesses and differences. Contrast - to show differences 
when compared. Group - to cluster. Infer - to derive as aconclusion from facts or premises. Sequence - chronological order of events, or 
Synthesize -the combination of parts or elements into a whole. 

1 

Demonstrates partial understanding of the material. Some requirements are met. 

Level One (Define); focus on gathering and recalling gathered information. 

Signal Words. Describe - to represent or give an account in words. Identify - to establish the identity of. List - a simple series of words or 
numbers. Name-to mention or identify by name. Observe-to see or sense esp. through careful attention. Recite-to repeat verbatim, and 
Scan-to examine closely. 

0 

No response; Task not attempted. 
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Table 4 

Holistic Rubric Template using Kirkpatrick’s Four Levels 


Score 

Description 

4 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded. 

Level Four (Results). To what degree targeted outcomes occur as a result of the training event and subsequent reinforcement. 

Indicators. Indicators (measure indirectly). The assignment incorporates a plan of action which will apply the assignment and an 
analysis ofthe likely of success and resources needed. Wewl/l/orWAdd/t/on; Leading Indicators. A plan for short-term observations and 
measurements suggesting that critical that would measure the behaviors and howto indicate if they are on track to create a positive 
impacton desired results. 

3 

Demonstrates consistent understanding ofthe material. All requirements are met. 

Level Three (Behavior). To what degree participants apply what they learned during training when they are back on the job. 

Indicators. Indicators (measured indirectly). The assignment includes an indication of intention to use what was include in the assignment, 
practical application, process to carry it out, skills, knowledge, or attitude. New World Addition: Required Drivers. The student includes a 
discussion of processes and systems that reinforce, encourage and reward performance of critical behaviors on their job. 

2 

Demonstrates partial understanding ofthe material. Some requirements are met. 

/.eve/two (Learning). To what degree participants acquire the intended knowledge, skills, attitudes, confidence and commitment based on 
their participation in a training event 

Indicators. Knowledge. Indications of “knowing" the material from the assignment. Tell, list, describe, name, repeat, remember, recall, 
identify, state, select, match, know, locate, report, recognize, observe, choose, who, what, where, when, cite, define, indicate, label, 
memorize, outline, record, relate, reproduce, underline. Skill. Indication ofthe student's confidence that they can now do what is include 
or required in the assignment. Attitude. Indication that what is include in the assignment will be worthwhile or useful on the job. New World 
Additions: Confidence. Indication that they believe they can apply the content ofthe assignment. Commitment. Indication ofthe intention 
to use the content ofthe assignment. 

1 

Demonstrates minimal understanding ofthe material. Few requirements are met. 

Level one (Reaction). To what degree participants react favorably to the training. 

Indicators. Customer Satisfaction. Indications of satisfaction with the concepts addressed in the assignment, met their needs, and 
achieved a goal./Vewl/l/or/dAdcf/t/ons; Engagement. Indications ofthe student's active involved in and contributing to the learning 
experience, mentally stimulated, attention, curiosity, interest, optimism, and passion. Relevance. Indication of an opportunity to use 
or apply what they learned from the assignment, application to the personal aspirations, interests, or cultural experiences of students 
{personalrelevance) or that are connected in some way to real-world issues, problems, and contexts {life relevance). 

0 

No response; Task not attempted. 
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Table 5 

Analytic Rubric Template using Bloom’s Taxonomy 



Beginning 

1 

Developing 

2 

Accomplished 

3 

Exemplary 

4 

Accomplished 

3 

Exemplary 

4 

Score 

Category#! 

Description 

Description 

Description 

Description 

Description 

Description 



reflecting 

reflecting 

reflecting 

reflecting 

reflecting 

reflecting 



beginning level 

movement toward 

acbievement of 

highest level of 

achievement of 

highest level of 



of performance. 

mastery level of 

mastery level of 

performance. 

mastery level of 

performance. 



Knowledge 

performance. 

performance. 

Analysis 

performance. 

Comprehension 



(Remembering) 

Evaluation 

Synthesis 

(Analyzing) 

Application 

(Understanding) 



Learn specific 

(Evaluating) 

(Creating) 

Abilityto break 

(Applying) 

Abilityto grasp 



facts, ideas, 

Abilitytojudgetbe 

Ability to put parts 

down material 

Abilityto use 

the meaning 



vocabulary; 

value of material 

togetbertoform 

into itscompo- 

learned material in 

of material; 



remembering 

(statement. 

a new whole; use 

nent parts and 

new and concrete 

communicate 



recalling 

novel, poem. 

elements in new 

perceive inter- 

situations; use 

knowledge; 



information or 

report, etc.) for 

patterns and 

relationships. 

learned knowledge 

understanding 



specific facts. 

a given purpose; 

relationships. 


and interpret 

information 




judgment is based 



previous situations 

without relating it 




on given criteria. 




to other material 



Table 6 

Analytic Rubric Template using Costa Three Levels 



Developing 

1 

Accomplished 

2 

Exemplary 

3 

Score 

Category#! 

Description reflecting movement 
toward mastery level of performance. 
Level One (Define);focus on gathering 
and recalling gathered information. 
Signal Words. Describe -to represent 
or give an account in words. Identify 
-to establish the identity of. List - a 
simple series of words or numbers. 
Name - to mention or identify by 
name. Observe - to see or sense esp. 
through careful attention. Recite 
- to repeat verbatim, and Scan - to 
examine closely. 

Description reflecting achievement of 
mastery level of performance. 

Level Twe (Analyze); making sense of 
gathered information. 

Signal Words. Examine - a thing to 
know its parts. Compare - to examine 
for likenesses and differences. 

Contrast - to show differences when 
compared. Group - to cluster. Infer - 
to derive as a conclusion from facts or 
premises. Sequence - chronological 
order of events, or Synthesize - the 
combination of parts or elements into 
awhole. 

Description reflecting highest level of 
performance 

Level Three (Apply); applying and 
evaluating gathered information. 

Signal Words. Evaluate - appraise, 
value. Hypothesize - to adopt as a 
hypothesis/assumption. Imagine - to 
form a mental picture of something 
not present; guess. Judge - to form 
an estimate or evaluation about 
something. Deduce, Predict -to 
declare in advance, or speculate - to 
think or wonder about a subject. 
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Table 7 

Analytic Rubric Template using Kirkpatrick’s Four Levels 



Beginning 

1 

Developing 

2 

Accomplished 

3 

Exemplary 

4 

Score 

Category#! 

Description reflecting 
beginning level of 
performance. 

Level ene (Reaction). To what 
degree participants react 
favorably to thetraining. 
Indicators. Customer 

Satisfaction. Indications 

ofsatisfaction with the 
conceptsaddressedin 
theassignment,met their 
needs.and achieved a 
goal. Wew WerldAdditiens: 
Engagement. Indications 
of the student's active 
involved in and contributing 
to the learning experience, 
mentally stimulated, 
attention, curiosity, interest, 
optimism, and passion. 
Relevance. Indication of an 
opportunity to use or apply 
what they learned from the 
assignment, application to 
the personal aspirations, 
interests, or cultural 
experiencesof students 
{persenal relevance) orthat 
are connected in some way to 
real-world issues, problems, 
and contexts {life relevance). 

Description reflecting 
movement toward mastery 
level of performance. 

Level twe (Learning). To what 
degree participants acquire 
the intended knowledge, 
skills, attitudes, confidence 

and commitment based 

on their participation in a 
training event 

Indicators. Knowledge. 
Indications of'knowing" 
the material from the 
assignment.Tell, list, 
describe, name, repeat, 
remember, recall, identify, 
state, select, match, know, 
locate, report, recognize, 
observe, choose, who, what, 
where, when, cite, define, 
indicate, label, memorize, 
outline, record, relate, 
reproduce, underline. Skill. 
Indication of the student's 
confidencethattheycan now 
do what is include or required 
in the assignment. Attitude. 
Indication that what is include 

in the assignment will be 
worthwhile or useful on the 
job. Wew WerldAdditiens: 
Confidence. Indication 
that they believe they can 
apply the content of the 
assignment. Commitment. 

Indication of the intention 

to use the content of the 
assignment. 

Description reflecting 
achievement of mastery level 
of performance. 

Level Three (Behavior). To 
what degree participants 
apply what they learned 
during training when they are 
back on the job. 

Indicators. Indicators 
(measured indirectly). 

The assignment includes 
an indication of intention 

to use what was include in 
the assignment, practical 
application, process to carry 
it out,skills, knowledge, or 
attitude. New WerldAddItlen: 
Required Drivers. The 
student includesadiscussion 

of processes and systems 
that reinforce, encourage 
and reward performance of 
critical behaviors on their job. 

Description reflecting 
highest level of performance. 
Leve/four (Results). To 
what degree targeted 
outcomes occur as a result 
ofthe training event and 
subsequent reinforcement. 
Indicators. Indicators 
(measure indirectly). The 
assignment incorporates 
apian ofaction which will 
apply the assignment and 
an analysis ofthe likely of 
success and resources 

needed. Wew WerldAddItlen: 
LeadingIndicaters. A plan for 
short-term observations and 
measurements suggesting 
that critical thatwould 

measure the behaviors and 
howto indicate if they are 
on track to create a positive 
impact on desired results. 
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Table 8 

Single-Point Rubric Template using Bloom’s Taxonomy 


Concerns 

Areas that Need Work 

Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 

Description reflecting beginning level of 
performance. Knowledge (Remembering) 

Criteria#!: 

Description reflecting acbievement of mastery 
level of performance. 

Description reflecting acbievement of mastery 
level of performance. 

Description reflecting acbievement of mastery 
level of performance. Synthesis (Creating) 

Description reflecting bigbest level of 
performance Description reflecting bigbest 
level of performance. Comprehension 
(Understanding) 


Table 9 

Single-Point Rubric Template using Costa Three Levels 


Concerns 

Areas that Need Work 

Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 

Description reflecting movement toward mastery 
level of performance. 

LevelOne (Define); 

Criteria #1: Description reflecting achievement of 
mastery level of performance. 

Description reflecting achievement of mastery 
level of performance. 

Level Twe (Analyze); 

Description reflecting highest level of 

performance 

/.eve/Ihree (Apply); 


Table 10 

Single-Point Rubric Template using Kirkpatrick’s Four Levels 


Concerns 

Areas that Need Work 

Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 

Description reflecting beginning level of 
performance. 

/eve/one (Reaction). 

Criteria#!: Description reflecting achievement of 
mastery level of performance. 

Level Three (Behavior). 

Description reflecting achievement of mastery 
level of performance 

Description reflecting achievement of mastery 
level of performance. 

Level Three (Behavior). 
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Table 11 


Template Developmental Rubric 


Example Domain/ 
Standard 

Initial Level 

Intermediate Level 

Mature Level 

Cognitive 

Assumes knowledge is certain 
and categorizes knowledge claims 
as right or wrong; is naive about 
differences; resists challenges 
to one's own beliefs and views 
perspectives as wrong 

Evolving awareness and 
acceptance of uncertainty and 
multiple perspectives; ability to 
shift from accepting authority's 
knowledge claimsto personal 
processesforadopting knowledge 
claims 

Abilityto consciously shift 
perspectives and behaviors 
into an alternative viewpoint or 
worldviewand to use multiple 
frames 

Intrapersonal 

Lack of awareness of one's own 

values and intersection of others; 
lackof understanding of other 
views; externally defined identity 
yields externally defined beliefs 
that regulate interpretation of 
experiences and guide choices; 
difference isviewed asathreatto 
identity 

Evolving sense of identity as distinct 
from external others' perceptions; 
tension between external and 
internal definitions prompts self¬ 
exploration of values; recognizes 
legitimacy of other viewpoints 

Capacity to create an internal 
selfthat openly engages 
challengesto one'sviews and 
beliefs and that considers 
viewpoints in a global and 
national context; integrates 
aspects of self into one's identity 

Interpersonal 

Dependent relations with similar 
others is a primary source of 
identity and social affirmation; 
perspectives of different others 
are viewed as wrong; awareness of 
others differences is lacking; view 
problems egocentrically 

Willingnessto interact with diverse 
others and refrain from judgment; 
relies on independent relations in 
which multiple perspectives exist 
(but are not coordinated); self is 
often overshadowed by need for 
others' approval. Beginsto explore 
other viewpoints 

Capacityto engage in 
meaningful, interdependent 
relationships with diverse 
others that are grounded in an 
understanding and appreciation 
for differences; willing to 
recognize change 


King, P.NI. & Baxter Magolda, M. B., pp. 571-592,2005. 
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Table 12 

Holistic Rubric using the Bloom Taxonomy Criteria description for the two examples: Course Content and 
Course Style Examples. 


Score 

Description 

6 

Demonstrates exceptional understanding by Creating, putting elements together to form a coherent or functional whole of the 
relationships between business terminology, concepts, and current business issues; putting elements together to form a coherent or 
functional whole; a new pattern or structure. 

6 

Demonstrates exceptional understanding by Creating orreorganizing elements into a new pattern or structure through generating, 
planning, or producing the effective use and application of APA style writing; applying, evaluate, and judge. 

Score 

Description 

1 

Demonstrates minimal understanding of the material Few requirements are met Remembering relevant knowledge of the relationships 
between business terminology, concepts, and current business issues; describing, recognizing, and recalling relevant knowledge. 

1 

Demonstrates minimal understanding of the material. Few requirements are met. Remembering the effective use and application of APA 
style writing 


Table 13 

Holistic Rubric using Costa’s Three Levels description for the two examples Course Content and Course 
Style Examples. 


Score 

Description 

3 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded. Levei Three (Apply); applying 
and evaluating gathered information aboutthe business terminology, concepts, and current business issues; applying and evaluating 
gathered information. 

3 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded. Levei Three (Apply); applying 
and evaluating the effective use and application of APA style writing; applying, evaluate, and judge. 

Score 

Description 

1 

Demonstrates partial understanding ofthe material. Some requirements are met. Levei One (Define);focus on recalling the business 
terminology, concepts, and current business issues; applying and evaluating gathered information. 

1 

Demonstrates partial understanding ofthe material. Some requirements are met. 

Levei One (Define); focus on the effective use and application of APA style writing; describe, identify, list, name, and scan. 
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Table 14 

Holistic Rubric using Kirkpatrick’s Four Levels Criteria description for the two examples: Course Content 
and Course Style Examples 


Score 

Description 

4 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded and included a plan for the 
application of the business terminology, concepts, and current business issues; results-a plan for action which will apply the assignment, a 
plan to measure the behaviors and howto indicate if they are on trackto create a positive impact on desired results. 

4 

Demonstrates exceptional understanding of the material. All requirements are met and some are exceeded and included a plan for the 
application of the effective use and application of APA style writing; results-assignment incorporates a plan of action indicate if they are on 
trackto create a positive impact on desired results. 

Score 

Description 

1 

Demonstrates minimal understanding of the material. Few requirements are met. A lack of personal or life relevance of the business 
terminology, concepts, and current business issues; results-a plan of action which will apply the assignment, a plan to measure the 
behaviors and howto indicate if they are on trackto create a positive impact on desired results. 

1 

Demonstrates minimal understanding of the material. Few requirements are met. A lack of personal or life relevance of the effective use 
and application of APA style writing; reaction-indications of the student's active involved in and contributing to the learning experience, 
mentally stimulated, attention, curiosity, interest, optimism, and passion, connected in some way to real-world issues, problems, and 

contexts 
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Table 15 

Analytic Rubric using Bloom’s Taxonomy for Course Content and Course Style Examples 


Analytic 

Knowing 

1 

Comprehension 

2 

Application 

3 

Analysis 

4 

Synthesis 

3 

Evaluation 

4 

Score 


Category 
#1 Course 

Content 

Description 
reflecting 
beginning level 
ofperformance; 
by describing 
specific facts, 
ideas, vocabulary 
in identifying and 
analyzing business 
cycles. 

Description 

reflecting 

movement 

toward a level of 
performance; by 
identifying and 
analyzing business 
cycles. 

Description 
reflecting 
achievement of 
a higher level of 
performance; 
identifying and 
analyzing business 
cycles. 

Description 
reflecting 
highest level of 
performance; in 
identifying and 
analyzing business 
cycles. 

Description 
reflecting 
achievement of 

mastery level of 
performance: in 
identifying and 
analyzing business 
cycles. 

Description 
reflecting highest 
level of mastery; 
by identifying and 
analyzing business 
cycles. 


Category #2 

Description 

Description 

Description 

Description 

Description 

Description 


Course Style 

reflecting 

reflecting 

reflecting 

reflecting 

reflecting 

reflecting 



beginning level 

movement 

achievement of 

highest level of 

achievement of 

achievement of 



ofperformance; 

toward a level of 

a higher level of 

performance; 

mastery level of 

mastery level of 



by remembering 

performance; 

performance; 

by listing the five 

performance; by 

performance; by 



(listing) tbe 

by showing tbe 

by synthesizing 

levels of APA style 

applying the five 

applying the five 



specific facts 

value (in order) 

(relationship 

headings. 

levels of APA style 

levels of APA style 



related to listing 

related to the five 

to subject 


headings. 

headings. 



tbe five levels 

levels of APA style 

sentences) the 






of APA style 

headings. 

relationship by 






headings. 


listing the five 








levels of APA style 








headings. 






Table 16 

Analytic Rubric using Costa’ Three Levels for Course Content and Course Style Examples 



Developing 

1 

Accomplished 

2 

Exemplary 

3 

Score 

Category#! 
Course Content 

Description reflecting movement 
toward mastery level of performance 
by defining, describing, identifying and 
analyze business cycles. 

Description reflecting achievement 
of mastery level of performance. 
Thestudentwillidentify,compare, 
contrast, synthesize and analyze 
business cycles. 

Description reflecting highest level of 
performance The student will identify, 
analyze, and evaluate the business 
cycles. 


Category #2 

Description reflecting movement 

Description reflecting achievement 

Description reflecting highest level 


Course Style 

toward mastery level of performance 
by defining, describing, and examine 
factors related to listing the five levels 
of APA style headings. 

of masterylevel ofperformance by 
analyzing, examining, comparing, 
contrasting, synthesize factors 
related to listing the five levels of APA 
style headings. 

ofperformance by applying, and 
evaluating the five levels of APA style 
headings. 
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Table 17 

Analytic Rubric using Kirkpatrick’s Four Levels for Course Content and Course Style Examples 



Beginning 

1 

Developing 

2 

Accomplished 

3 

Exemplary 

4 

Score 

Category#! 
Course Content 

Description reflecting 
beginning level of 
performance The student 
will apply, identify, and 
analyze business cycles. 

Description reflecting 
movement toward mastery 
level of performance 

The student will apply with 
confidence, identify, and 
analyze business cycles. 

Description reflecting 
achievement of mastery 
level of performance 

The student will show an 
application, identify, and 
analyze business cycles. 

Description reflecting 
highest level of 
performance 

The student will plan for 
short-term observations 
and measurements, identify, 
and analyze business cycles. 


Category #2 

Description reflecting 

Description reflecting 

Description reflecting 

Description reflecting 


Course Style 

beginning level of 
performance. 

The student will list the five 
levelsofAPAstyle headings 
and connected in some 
way to real-world issues, 
problems, and contexts. 

movement toward mastery 
level of performance. The 
student will list the five 

levelsofAPA style headings 
andacquirethe intended 
knowledge, skills. 

achievement of mastery 
level of performance 

The student will list the five 
levels of APA style headings 
and participants apply what 
they learned. 

highest level of 
performance 

The student will list the five 
levels of APA style headings 
and proposed measuresto 
evaluate, and get feedback. 



Table 18 

Single-Point Rubric using Bloom’s Taxonomy-Course Content and Course Style Examples 


Concerns 

Areas that Need Work 

Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 


Criteria#!: 

Description reflecting achievement of mastery 
level of performance. The student will correctly 
define GDP asthe output in dollars (or another 
currency) of final goods and services produced in 
a country in a given year 



Criteria #2: 

Description reflecting achievement of mastery 
level of performance. The student will correctly 
list and apply the five levels of APA style headings. 
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Table 19 

Single-Point Rubric using Costa Three Levels Course Content and Course Style Examples 


Concerns 

Areas that Need Work 

Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 


Criteria #1: Course Content. 

Description reflecting achievement of mastery 
level of performance the student will define GDP 
as the output in dollars (or another currency) of 
final goods and services produced in a country 
in a given year with an application of what they 

learned 



Criteria #2: Course Style. 

Description reflecting achievement of mastery 
level of performance. The student will correctly 
list and apply the five levels of APA style headings 
with an application of what they learned 



Table 20 

Single-Point Rubric using Kirkpatrick’s Four Levels Course Content and Course Style Examples 


Concerns 

Areas that Need Work 

Criteria 

Standards for This Performance 

Advanced 

Evidence of Exceeding Standards 


Criteria #1: Course Content. 

Description reflecting achievement of mastery 
level of performance 

The student will define GDP as the output in 
dollars (or another currency) of final goods and 
services produced in a country in a given year with 
an application of what they learned 



Criteria #2: Course Style. 

Description reflecting achievement of mastery 
level of performance. 

The student will correctly list and apply the five 
levels of APA style headings with an application of 
what they learned 
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Table 21 

A Rubric for Judging Your Rubric 


Criteria 

Beginning 

Developing 

Accomplished 

Exemplary 

Statement of Purpose 
Purpose is clearly stated 

Purpose is not clearly 
stated. 

Purpose is somewhat 
clearly stated. 

Purpose is mostly clearly 
stated. 

Purpose is very clearly 
stated. 

Criteria. 

■ observable and measurable 

•reflect important and 
essential elements 

• distinct from other criteria 
•clear and unambiguous 
language. 

Few ofthe criteria are 

ebservable and measurable; 
few reflect the mest 
impertant and essential 
elements efthetask;few 

are written with clear and 
unambigueus language. 

Some ofthe criteria are 

observable and measurable; 

some reflect the most 
important and essential 
elements of the task; some 

are written with clear and 
unambiguous language. 

Most ofthe criteria are 
observable and measurable; 
most reflect the most 
important and essential 
elements of the task; most 

are written with clear and 
unambiguous language. 

All ofthe criteria are 
observable and measurable; 
all reflect the most 
important and essential 
elements of the task; all 

are written with clear and 
unambiguous language. 

Rating Scale. The number 
of items reflects purpose of 

assessment. 

The number ef rating peints 
dees net reflect the purpese 
ef the assessment. 

The number of rating points 

somewhat reflects the 
purpose ofthe assessment. 

The number of rating points 
mostly reflects the purpose 
ofthe assessment. 

The number of rating points 
clearly reflects the purpose 
ofthe assessment. 

Performance Descriptors. 

• observable and measurable 

• use parallel language across 
the scale 

• Indicate amount, frequency 
or intensity 

Few efthe perfermance 
descripters are ebservable 
and measurable; few use 
parallel language acressthe 
scale; few indicate ameunt, 
frequency er intensity. 

Some ofthe performance 
descriptors are observable 
andmeasurable;someuse 
parallel language acressthe 
scale; some indicate amount, 
frequency or intensity. 

Most ofthe performance 
descriptors are observable 
and measurable; most use 
parallel language across the 
scale; most indicate amount, 
frequency or intensity. 

All ofthe performance 
descriptors are observable 
and measurable; all use 
parallel language acressthe 
scale; all indicate amount, 
frequency or intensity. 

Reliability. 

•inter-rater reliability 
(consistent scoring among 
multiple graders) 

•intra-rater reliability 
(consistent scores with the 
same graderovertime) 

Rubric dees net previde 
inter-raterer intra-rater 
reliability. 

Rubric providessome 
inter-rater and intra-rater 
reliability. 

Rubric mostly provides 
inter-rater and intra-rater 
reliability. 

Rubric providesstrong 
inter-rater and intra-rater 
reliability. 

Validity. 

•content validity (skills 
measured represent the 
skills inthe broaderdomain 
area) 

• construct validity (criteria 
reflect the knowledge and 
skills you are attempting to 
measure) 

•criterion validity (rubric 
score is similar to a score 
given in a real-world 
context) 

• face validity (rubric appears 
to be valid to its users) 

Rubric does not provide 
content, construct, 
criterion, or face validity. 

Rubric provides some 
content, construct, 
criterion, and face 
validity. 

Rubric mostly provides 
content, construct, 
criterion, and face 
validity. 

Rubric provides strong 
content, construct, 
criterion, and face 
validity. 


Stevens & Levi, 2004 
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Metarubric Checklist 


49 


Rubric part 

Evaluation criteria 

Yes 

No 

The dimensions 

Does each dimension cover important parts of the final student performance? 



Does the dimension capture some key themes in your teaching? 



Are the dimensions clear? 



Are the dimensions distinctly different from one another? 



Do the dimensions represent skills that the student knows something about already (e.g., 
organization, analysis)? 



The descriptions 

Do the descriptions match the dimensions? 



Are the descriptions clear and different from each other? 



If you used points, is there a clear basisfor assigning points for each dimension? 



If using athree-to-five level rubric, are the descriptions appropriately and egually 
weighted across the three-to-five levels? 



The scaie 

Do the descriptors under each level truly represent that level of performance? 



Are the scale labels encouraging and still quite informative without being negative and 
discouraging? 



Does the rubric have a reasonable number of leveisfor the age of the student and the 
complexity of the assignment? 



The overaii rubric 

Does the rubric clearly connect to the outcomes that it is designed to measure? 



Can the rubric be understood by external audiences? 



Does it reflect teachable skills? 



Does the rubric reward or penalize students based on skills unrelated to the outcome 
being measured that you have not taught? 



Have all students had an equal opportunity to learn the content and skills necessary to be 
successful on the assignment? 



Is the rubric appropriate for the conditions under which the assignment was completed? 



Does the rubric Include the assignment description or title? 



Does the rubric address the student's performance as a developmental task? 



Does the rubric inform the student about the evaluation procedures when their work is 
scored? 



Does the rubric emphasize the appraisal of individual or group performance and indicate 
ways to improve? 



Fairness and sensibiiity 

Does it look like the rubric will be fair to all students and free of bias? 



Does it look like it will be useful to students as performance feedback? 



Isthe rubric practical given the kind of assignment? 



Does the rubric make sense to the reader? 




(Stevens & Levi, 2004). 
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